System Usability Research Articles

Forming a view: a human factors case study of augmented reality collaboration in assembly.

Industry 4.0 technology is promoted as improving manufacturing flexibility, and competitiveness; though Australia has been slow to adopt. The Australian Navy shipbuilding program provides opportunities for accelerating technology adoption, revitalising manufacturing productivity and competitiveness. Adopting a sociotechnical systems lens, our research sought to identify usability, workload, and user experience of an augmented reality head-mounted display (AR-HMD) deployed to complete multiple work tasks in a workflow (electrical assembly, collaborative robot (cobot) mediated inspection, and remote troubleshooting using video call). Usability was rated 'average' (System Usability Scale mean = 69.8) and workload 'acceptable' (NASA Task Load Index mean = 25.8) for the AR-HMD alone, with usability of the integrated work system (IWS) rated 'good' (SUS mean = 79.2). Results suggest software interfaces, tracking, and gesturing methods for the AR-HMD require improvement. This trial shows the AR-HMD provides a versatile platform for integrating multiple digital technologies without hindering effectiveness of end-user performance, potentially benefiting productivity and quality.

Feasibility and safety report on robotic assistance for cervical pedicle screw fixation: a cadaveric study

This cadaveric study aimed to evaluate the safety and usability of a novel robotic system for posterior cervical pedicle screw fixation. Three human cadaveric specimens and C2-T3 were included. Freshly frozen human cadaver specimens were prepared and subjected to robot-assisted posterior cervical pedicle screw fixation using the robotic system. The accuracy of screw placement, breach rate, and critical structure violations were evaluated. The results were statistically compared with those of previous studies that used different robotic systems for cervical pedicle screw fixation. The robotic system demonstrated a high accuracy rate in screw placement. A significant number of screws were placed within predetermined safe zones. The total entry offset was 1.08 ± 0.83 mm, the target offset was 1.86 ± 0.50 mm, and the angle offset was 2.14 ± 0.77°. Accuracy rates comparable with those of previous studies using different robotic systems were achieved. The system was also feasible, allowing precise navigation and real-time feedback during the procedure. This cadaveric study validated the safety and usability of the novel robotic system for posterior cervical pedicle screw fixation. The system exhibited high precision in screw placement, and the results support the extension of the indications for robot-assisted pedicle screw fixation from the lumbar spine to the cervical spine.

An online pain management program for people with hypermobile Ehlers-Danlos Syndrome or hypermobility spectrum disorder: a three-staged development process

Purpose Hypermobile Ehlers-Danlos Syndrome (hEDS) and hypermobility spectrum disorder (HSD) are painful, chronic and multi-systemic conditions. No online pain management programs for hEDS/HSD currently exist. We aimed to develop one by exploring what people with hEDS/HSD want in such programs. Materials and methods A Delphi was conducted via online surveys of stakeholders: participants with hEDS/HSD and healthcare professionals (HCP). In survey 1, participants were asked if a hEDS/HSD-specific online pain management program was important, listing up to 20 topics important to know about pain. In survey 2, participants rated the importance of those topics. Consensus was set as ≥75% rating of at least “important”. Using topics that reached consensus, the online program was developed. Usability testing was performed using the Systems Usability Scale (SUS). Results 396 hEDS/HSD and 29 HCP completed survey 1; 151 hEDS/HSD and 12 HCP completed survey 2. 81% of hEDS/HSD and 69% of HCP rated a hEDS/HSD-specific program as at least “important”. Thirty-five topics reached consensus to guide content for the HOPE program (Hypermobile Online Pain managemEnt). SUS score was 82.5, corresponding to “high acceptability”. Conclusions A hEDS/HSD-specific online pain management program is important to stakeholders. Utilising a Delphi approach to incorporate stakeholder input, an evidence-informed and user appropriate program was developed.

СОВРЕМЕННЫЙ ПОДХОД К ОЦЕНКЕ ПЕРИНАТАЛЬНОГО РИСКА, ОСНОВАННЫЙ НА ИСПОЛЬЗОВАНИИ ПРОГНОСТИЧЕСКИХ КРИТЕРИЕВ АНТЕНАТАЛЬНЫХ, ИНТРАНАТАЛЬНЫХ И РАННИХ НЕОНАТАЛЬНЫХ ПОТЕРЬ

The problem of perinatal losses is still actual in obstetrics today. At the same time there are cases of non-estimation or extra-estimation of perinatal risk in obstetrical practice. The usage of famous prognostic systems gives the opportunity to select pregnant women into groups of high risk and provide the necessary organizational and tactic measures. But to define the character of possible complications, to establish the degree of their severity and time of appearance is really impossible. Objective of the study: to develop a new approach to estimation of perinatal risk based on the determination of prognostic criteria for antepartum and intrapartum fetal death, early neonatal death of a newborn in order to increase the efficacy of predicting of unfavourable perinatal outcomes. Materials and research methods. The retrospective case-control study in patients with antepartum (n=134) and intrapartum (n=41) fetal death, early neonatal death of the newborn (n=61) and favourable perinatal outcome (n=50) was conducted. There was used the Bayes algorhythm with Wald's consecutive analysis in the modification of Genkin-Gubler to determine prognostic criteria. The comparative estimation of the efficacy of the proposed prognostic method and traditional method of determining perinatal risk was performed retrospectively in patients with perinatal losses (n=102) and favourable perinatal outcome (n=100). ROC analysis was performed. Results. There were identified 42 risk factors divided into three groups: universal for all types of perinatal losses, common for two of them and specific for each of them (antepartum and intrapartum fetal death, early neonatal death of a newborn). There was determined the prognostic influence of factors in their presence and absence. It was found that universal and common risk factors had different prognostic influence for each type of perinatal losses. There was presented the method for differential predicting of perinatal losses. The sensitivity of the new and traditional prognostic methods was 95.1% and 69.6%, specificity was 80% and 53%, and the accuracy of predicting of unfavourable outcome was 87.6% and 61.4% respectively. Conclusion. The investigation permitted to propose the new approach to estimation of perinatal risk, based on differential predicting of perinatal losses being is more effective than traditional method in predicting adverse perinatal outcomes.

Subscription intentions for ChatGPT plus: a look at user satisfaction and self-efficacy

PurposeThis study examines the key determinants of subscription intentions for ChatGPT Plus (paid version) in business settings, focusing on tasks such as system quality, information support, service quality, perceived intelligence, goal-congruent outcome and self-efficacy.Design/methodology/approachThe study utilized a survey of office workers, analyzed through structural equation modeling, to explore these determinants.FindingsThe results demonstrate that system quality, service quality and perceived intelligence significantly influence satisfaction, while service quality and perceived intelligence also impact goal-congruent outcomes. Contrary to traditional models, satisfaction does not significantly correlate with usage. Instead, a significant relationship is observed between goal-congruent outcomes and usage. Self-efficacy emerges as a crucial predictor of subscription intentions, further underlined by the significant impact of usage on subscription intention.Research limitations/implicationsThe study’s focus on office workers and a single artificial intelligence (AI) chatbot type may limit generalizability. Its findings illuminate several avenues for future research, particularly in diversifying the context and demographics studied.Practical implicationsThis research offers actionable insights for businesses and practitioners in the implementation of AI chatbots. It highlights the importance of enhancing system quality, personalization and user confidence to boost subscription intentions, thereby guiding strategies for user engagement and technology adoption.Originality/valueThis study pioneers in investigating subscription intentions towards AI chatbots, particularly ChatGPT, providing a novel framework that expands upon traditional user behavior theories.

Usability evaluation of the educational website “understanding my diabetes” for Mexican patients with type 2 diabetes

BackgroundDiabetes education is an integral part of the treatment for the metabolic control of patients with diabetes. The use of the Internet as a tool for diabetes education, as well as its acceptance, is still under study.AimTo assess the usability of the educational website “I understand my diabetes” designed for patients with type 2 diabetes attending primary care clinics.Material and methodA cross-sectional study was done in 110 patients with type 2 diabetes from two family medicine clinics, each of whom was assigned a user account on the educational website “Entiendo mi diabetes.” The web site assigned a user name and password to each patient. They were able to access the educational website at home. After a 15-day review period, participants were asked to evaluate usability using the Computer System Usability Questionnaire. Additionally, we developed an eight-item questionnaire usability focusing on diabetes care. Sociodemographic data, blood pressure, and anthropometric measurements were recorded. Glucose levels and lipid profiles were also measured.ResultsThe patients with diabetes had a mean age of 52.7 years and a median of 5 years since they were diagnosed with diabetes. The website received a good usability rating from 89.1% of participants, with favorable assessments in all three dimensions: 87.3% for information, 85.5% for quality, and 88.2% for interface. Regarding usability specifically for diabetes care, 98.2% rated it as having good usability.ConclusionThe website for education about the disease in patients “I understand my diabetes” had an adequate usability evaluation by patients, so they also considered it very useful for diabetes care. The diabetes care instrument had adequate usability and reliability.

Co-design and usability of an interactive web-based fertility decision aid for transgender youth and young adults.

To develop a patient- and family-centered Aid For Fertility-Related Medical Decisions (AFFRMED) interactive website targeted for transgender and nonbinary (TNB) youth/young adults and their parents to facilitate shared decision-making about fertility preservation interventions through user-centered participatory design. TNB youth/young adults interested in or currently receiving pubertal suppression or gender-affirming hormone treatment and parents of eligible TNB youth/young adults were recruited to participate in a series of iterative human-centered co-design sessions to develop an initial AFFRMED prototype. Subsequently, TNB youth/young adults and parents of TNB youth/young adults were recruited for usability testing interviews, involving measures of usability (i.e., After Scenario Questionnaire, Net Promotor Score, System Usability Scale). Twenty-seven participants completed 18 iterative co-design sessions and provided feedback on 10 versions of AFFRMED (16 TNB youth/young adults and 11 parents). Nine TNB youth/young adults and six parents completed individual usability testing interviews. Overall, participants rated AFFRMED highly on measures of acceptability, appropriateness, usability, and satisfaction. However, scores varied by treatment cohort, with TNB youth interested in or currently receiving pubertal suppression treatment reporting the lowest usability scores. We co-created a youth- and family-centered fertility decision aid prototype that provides education and decision support in an online, interactive format. Future directions include testing the efficacy of the decision aid in improving fertility and fertility preservation knowledge, decisional self-efficacy, and decision satisfaction.

Baby Vaccination Web Application

The Baby Vaccination System project aims to develop a comprehensive platform for managing child vaccination schedules efficiently. It incorporates frontend and backend development to provide users with tools for vaccine registration, tracking, and locating nearby vaccine centres. By targeting efficient management of vaccination schedules, the system contributes to public health initiatives and ensures timely immunisation for children. The objectives of the study include assessing the effectiveness of the system, evaluating user satisfaction, and determining the impact on vaccination completion rates. The study employs a mixed-methods approach, combining quantitative data analysis with qualitative feedback collection. Participants include parents or guardians of children eligible for vaccination, healthcare providers, and system administrators. Data collection methods include system usage metrics, surveys, and interviews. Ethical considerations include obtaining informed consent, ensuring participant confidentiality, and adhering to relevant ethical guidelines. The study findings will provide insights into the usability and effectiveness of the Baby Vaccination System in improving vaccination management.In today’s life style due to the heavy burden and pressure of work it is difficult to remember vaccine period on new born baby as well as small once. Keywords: Blockchain Vaccination System, Healthcare, Immunization, Public Health, Technology Integration

Comparative evaluation of the web-based contiguous cartogram generation tool go-cart.io.

Area cartograms are map-based data visualizations in which the area of each map region is proportional to the data value it represents. Long utilized in print media, area cartograms have also become increasingly popular online, often accompanying news articles and blog posts. Despite their popularity, there is a dearth of cartogram generation tools accessible to non-technical users unfamiliar with Geographic Information Systems software. Few tools support the generation of contiguous cartograms (i.e., area cartograms that faithfully represent the spatial adjacency of neighboring regions). We thus reviewed existing contiguous cartogram software and compared two web-based cartogram tools: fBlog and go-cart.io. We experimentally evaluated their usability through a user study comprising cartogram generation and analysis tasks. The System Usability Scale was adopted to quantify how participants perceived the usability of both tools. We also collected written feedback from participants to determine the main challenges faced while using the software. Participants generally rated go-cart.io as being more usable than fBlog. Compared to fBlog, go-cart.io offers a greater variety of built-in maps and allows importing data values by file upload. Still, our results suggest that even go-cart.io suffers from poor usability because the graphical user interface is complex and data can only be imported as a comma-separated-values file. We also propose changes to go-cart.io and make general recommendations for web-based cartogram tools to address these concerns.

Voice Assistant for Blind Person

This paper presents a comprehensive study on the design, implementation, and evaluation of a voice assistant system tailored specifically for visually impaired individuals. With the proliferation of voice-enabled devices, there exists a promising opportunity to empower visually impaired users through natural language interaction. Our proposed system incorporates advanced speech recognition, natural language understanding, and synthesis techniques to provide intuitive and efficient communication channels. Additionally, we address the unique challenges faced by visually impaired users, such as contextual understanding, accessibility, and usability. Through user studies and evaluations, we demonstrate the efficacy and usability of the proposed system, highlighting its potential to significantly enhance the independence and quality of life for visually impaired individuals in various daily tasks and activities

Factors influencing user experience in AI chat systems – a satisfaction study based on factor analysis and linear regression

PurposeSince the introduction of the outstanding web AI chat system, ChatGPT, it has caused a significant impact in both academia and the business world. Many studies have started to explore its potential applications in various fields. However, there is a lack of research from the perspective of user experience. To fill this theoretical gap and provide a theoretical basis for the operation and design of related services, this study plans to develop a set of evaluation scales for AI chat system user experience and explore the relationship between various factors and user satisfaction.Design/methodology/approachThis study obtained 41 evaluation indicators through literature review and user research. Subsequently, these indicators were used as questionnaire items, combined with satisfaction metrics. A total of 515 questionnaires were distributed, and factor analysis and linear regression were employed to determine the specific elements influencing user experience and the user satisfaction model.FindingsThis study found that the factors influencing user experience are usefulness, accuracy, logical inference, interactivity, growth, anthropomorphism, convenience, credibility, ease of use, creativity, and security. Among these factors, only accuracy, anthropomorphism, creativity, and security indirectly influence satisfaction through usefulness, while the rest of the factors have a direct positive impact on user satisfaction.Originality/valueThis study provides constructive suggestions for the design and operation of related services and serves as a reference for future theoretical research in this area.

Barriers to and Facilitators of Key Stakeholders Influencing Successful Digital Implementation of Remote Monitoring Solutions: Mixed Methods Analysis.

Implementation of remote monitoring solutions and digital alerting tools in health care has historically been challenging, despite the impetus provided by the COVID-19 pandemic. To date, a health systems-based approach to systematically describe barriers and facilitators across multiple domains has not been undertaken. We aimed to undertake a comprehensive mixed methods analysis of barriers and facilitators for successful implementation of remote monitoring and digital alerting tools in complex health organizations. A mixed methods approach using a modified Technology Acceptance Model questionnaire and semistructured interviews mapped to the validated fit among humans, organizations, and technology (HOT-fit) framework was undertaken. Likert frequency responses and deductive thematic analyses were performed. A total of 11 participants responded to the questionnaire and 18 participants to the interviews. Key barriers and facilitators could be mapped onto 6 dimensions, which incorporated aspects of digitization: system use (human), user satisfaction (human), environment (organization), structure (organization), information and service quality (technology), and system quality (technology). The recommendations proposed can enhance the potential for future remote sensing solutions to be more successfully integrated in health care practice, resulting in more successful use of "virtual wards." ClinicalTrials.gov NCT05321004; https://www.clinicaltrials.gov/study/NCT05321004.

Development and Implementation of a Carpooling Web Application

Development and Implementation of a Carpooling Web Application

Use of the FebriDx® host-response point-of-care test may reduce antibiotic use for respiratory tract infections in primary care: a mixed-methods feasibility study.

FebriDx® is a CE-marked, single-use point-of-care test with markers for bacterial [C-reactive protein (CRP)] and viral [myxovirus resistance protein A (MxA)] infection, using finger-prick blood samples. Results are available after 10-12 min. We explored the usability and potential impact of FebriDx® in reducing antibiotic prescriptions for lower respiratory tract infection (LRTI) in primary care, and the feasibility of conducting a randomized controlled trial (RCT). Patients (aged ≥1 year) with LRTI deemed likely to receive antibiotic prescription were recruited at nine general practices and underwent FebriDx® testing. Data collection included FebriDx® results, antibiotic prescribing plan (before and after testing) and re-consultation rates. Staff completed System Usability Scale questionnaires. From 31 January 2023 to 9 June 2023, 162 participants participated (median age 57 years), with a median symptom duration of 7 days (IQR 5-14). A valid FebriDx® result was obtained in 97% (157/162). Of 155 patients with available results, 103 (66%) had no detectable CRP or MxA, 28 (18%) had CRP only, 5 (3%) had MxA only, and 19 (12%) had both CRP and MxA. The clinicians' stated management plan was to prescribe antibiotics for 86% (134/155) before testing and 45% (69/155) after testing, meaning a 41% (95% CI: 31%, 51%) difference after testing, without evidence of increased re-consultation rates. Ease-of-use questionnaires showed 'good' user-friendliness. Use of FebriDx® to guide antibiotic prescribing for LRTI in primary care was associated with a substantial reduction in prescribing intentions. These results support a fully powered RCT to confirm its impact and safety.

A Personalized and Interactive Web-Based Advance Care Planning Intervention for Older Adults (Koda Health): Pilot Feasibility Study

Abstract Background Advance care planning (ACP) is a process that involves patients expressing their personal goals, values, and future medical care preferences. Digital applications may help facilitate this process, though their use in older adults has not been adequately studied. Objective This pilot study aimed to evaluate the reach, adoption, and usability of Koda Health, a web-based patient-facing ACP platform, among older adults. Methods Older adults (aged 50 years and older) who had an active Epic MyChart account at an academic health care system in North Carolina were recruited to participate. A total of 2850 electronic invitations were sent through MyChart accounts with an embedded hyperlink to the Koda platform. Participants who agreed to participate were asked to complete pre- and posttest surveys before and after navigating through the Koda Health platform. Primary outcomes were reach, adoption, and System Usability Scale (SUS) scores. Exploratory outcomes included ACP knowledge and readiness. Results A total of 161 participants enrolled in the study and created an account on the platform (age: mean 63, SD 9.3 years), with 80% (129/161) of these participants going on to complete all steps of the intervention, thereby generating an advance directive. Participants reported minimal difficulty in using the Koda platform, with an overall SUS score of 76.2. Additionally, knowledge of ACP (eg, mean increase from 3.2 to 4.2 on 5-point scale; P<.001) and readiness (eg, mean increase from 2.6 to 3.2 on readiness to discuss ACP with health care provider; P<.001) significantly increased from before to after the intervention. Conclusions This study demonstrated that the Koda Health platform is feasible, had above-average usability, and improved ACP documentation of preferences in older adults. Our findings indicate that web-based health tools like Koda may help older individuals learn about and feel more comfortable with ACP while potentially facilitating greater engagement in care planning.

Influential factors on the energy efficiency of fresh air systems in nearly zero energy buildings

Ensuring precise control of fresh air volume is crucial for minimizing energy usage in nearly zero energy buildings. Research shows that automatic pressure-independent dampers offer a promising solution for maintaining the desired fresh air volume. However, the energy performance of damper-controlled fresh air systems is influenced by multiple factors that have not been thoroughly investigated. This study focuses on examining the impact of influencing factors on the energy efficiency of fresh air systems. Laboratory experiments and field testing were conducted on a typical fresh air system. Subsequently, based on the experimental data, an energy saving model of the damper-controlled fresh air system was developed and validated. The main influencing factors were comprehensively investigated according to the energy-saving model. Results show that damper resistance is one of the main influencing factors on energy efficiency. Pressure-independent damper with a low resistance ratio of less than 48 % are recommended; When the average PM2.5 concentration increases by 1 µg/m3, the energy saving rate decreases by approximately 0.3 %, indicating that pressure-independent dampers are more suitable for use in regions with cleaner air; In the heating season, the energy saving rate increases by approximately 0.075 % when the dry bulb temperature decreases by 1 °C; In the cooling season, the energy saving rate increases by 1.19 % when the wet bulb temperature rises by 1 °C. This study contributes to the development of sustainable building practices by identifying key factors that influencing the energy usage of damper-controlled fresh air systems and further guiding the selection and utilization of pressure-independent dampers in nearly zero energy buildings.

Modified LDA vector and feedback analysis for short query Information Retrieval systems

Abstract Information Retrieval systems benefit from the use of long queries containing a large volume of search-relevant information. This situation is not common, as users of such systems tend to use very short and precise queries with few keywords. In this work we propose a modification of the Latent Dirichlet Allocation (LDA) technique using data from the document collection and its vocabulary for a better representation of short queries. Additionally, a study is carried out on how the modification of the proposed LDA weighted vectors increase the performance using relevant documents as feedback. The work shown in this paper is tested using three biomedical corpora (TREC Genomics 2004, TREC Genomics 2005 and OHSUMED) and one legal corpus (FIRE 2017). Results prove that the application of the proposed representation technique, as well as the feedback adjustment, clearly outperforms the baseline methods (BM25 and non-modified LDA).

Delivering clinical tutorials to medical students using the Microsoft HoloLens 2: A mixed-methods evaluation

BackgroundMixed reality offers potential educational advantages in the delivery of clinical teaching. Holographic artefacts can be rendered within a shared learning environment using devices such as the Microsoft HoloLens 2. In addition to facilitating remote access to clinical events, mixed reality may provide a means of sharing mental models, including the vertical and horizontal integration of curricular elements at the bedside. This study aimed to evaluate the feasibility of delivering clinical tutorials using the Microsoft HoloLens 2 and the learning efficacy achieved.MethodsFollowing receipt of institutional ethical approval, tutorials on preoperative anaesthetic history taking and upper airway examination were facilitated by a tutor who wore the HoloLens device. The tutor interacted face to face with a patient and two-way audio-visual interaction was facilitated using the HoloLens 2 and Microsoft Teams with groups of students who were located in a separate tutorial room. Holographic functions were employed by the tutor. The tutor completed the System Usability Scale, the tutor, technical facilitator, patients, and students provided quantitative and qualitative feedback, and three students participated in semi-structured feedback interviews. Students completed pre- and post-tutorial, and end-of-year examinations on the tutorial topics.ResultsTwelve patients and 78 students participated across 12 separate tutorials. Five students did not complete the examinations and were excluded from efficacy calculations. Student feedback contained 90 positive comments, including the technology’s ability to broadcast the tutor’s point-of-vision, and 62 negative comments, where students noted issues with the audio-visual quality, and concerns that the tutorial was not as beneficial as traditional in-person clinical tutorials. The technology and tutorial structure were viewed favourably by the tutor, facilitator and patients. Significant improvement was observed between students’ pre- and post-tutorial MCQ scores (mean 59.2% Vs 84.7%, p < 0.001).ConclusionsThis study demonstrates the feasibility of using the HoloLens 2 to facilitate remote bedside tutorials which incorporate holographic learning artefacts. Students’ examination performance supports substantial learning of the tutorial topics. The tutorial structure was agreeable to students, patients and tutor. Our results support the feasibility of offering effective clinical teaching and learning opportunities using the HoloLens 2. However, the technical limitations and costs of the device are significant, and further research is required to assess the effectiveness of this tutorial format against in-person tutorials before wider roll out of this technology can be recommended as a result of this study

Evaluation of an online arts-based platform to support the health and well-being of older adults during the COVID-19 pandemic: a cross-sectional survey

ObjectivesThe objective of this study was to conduct a formative evaluation of the Art Your Service (AYS) arts-based program to determine the program’s potential for improving the social and physical well-being of older adults during the COVID-19 pandemic.Design, settings and participantsAn online questionnaire was administered to the AYS members who consented to be invited to participate in the study. Questionnaire items consisted of a Likert scale and open-ended questions delivered using an online platform (SurveyMonkey). Participants provided feedback on their perceptions and experiences of the AYS program, such as its impact on their health and well-being during the COVID-19 pandemic, the benefits and challenges of participating, and any suggestions for program improvement.Outcome measures and analysisQuantitative data were analyzed using descriptive statistics (frequencies, means with standard deviations), and open-ended questions (qualitative data) were analyzed using content analysis. Outcomes included participant demographics, perceptions about the program, usability (System Usability Scale [SUS]), eHealth literacy (eHealth Literacy Scale), and social isolation (Lubben Social Network Scale; LSNS-6).ResultsProgram participants revealed consistent patterns of their perceptions and experiences about the program, including a high satisfaction rate (95%) and a perceived positive impact on participants’ health and well-being. The program sessions were perceived to be a well-organized, convenient, and safe way to engage with one another socially during the COVID-19 pandemic. The program usability was also perceived to be high (SUS mean score 86.2). Participants felt a sense of connectedness and had reduced feelings of social isolation. Most participants (75%) reported that the program improved their physical health.ConclusionsFindings from this formative evaluation study identified key strengths and opportunities to improve the Art Your Service arts-based program, which can be used to help enhance the program’s functioning and long-term sustainability potential.

Evaluating Academic Information Systems Through Dual Models

Evaluation of a system is needed to determine whether the system is still following organizational goals. For maximum results, evaluation should be done regularly. An academic information system is a system that aims to perform data processing so that it can provide convenient information that is used by users in academic administrative activities. This study proposes to determine the level of governance maturity in the monitoring and Evaluation domain of academic information systems at University ‘X’ a private in Indonesia and determine factors of the success of the information system. The results of the measurement process show that the maturity level of the system is at level 2.1 and the factors that affect the success of the system are System Quality, Quality of Service, User Satisfaction, and Net Benefits. The comparison specifically on System Quality and User Satisfaction relation has a less significant impact (0.2) while the IT Performance of the Monitor and Evaluate process is at the initial/ad hoc stage (level 1). In this study, the Quality of Information does not affect the success of the system. The results of this study provide recommendations for organizations to improve governance according to organizational goals to level 3 and to improve the Quality of Information in information systems.